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DETAILED ACTION 

Information Disclosure Statement 

1 . The listing of references in the specification is not a proper information disclosure 
statement. 37 CFR 1 .98(b) requires a list of all patents, publications, or other 
information submitted for consideration by the Office, and MPEP § 609.04(a) states, 
"the list may not be incorporated into the specification but must be submitted in a 
separate paper." Therefore, unless the references have been cited by the examiner on 
form PTO-892, they have not been considered. 

Specification 

1 . The disclosure is objected to because it contains an embedded hyperlink and/or 
other form of browser-executable code. Applicant is required to delete the embedded 
hyperlink and/or other form of browser-executable code. See MPEP § 608.01 . 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1 , 7, 8, and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jebara et al. ("Tracking Conversational Context for Machine 
Mediation of Human Discourse," 2000) in view of Suomela et al. (US 2002/0077830). 
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As per claims 1 and 8, Jebara et al. teach an information interface system and 
method, comprising: 

speech recognition means arranged to listen to voice signals carried on a 
communications channel between a user and another person, and to recognise at least 
one or more predefined keywords or phrases contained within the voice signals 
(System Overview, lines 1-6, speech recognizer which detects words); 

keyword processing means arranged to relate any recognised keywords or 
phrases to items of information stored in an information database so as to identify 
relevant items of information thereto (Implementation and System Overview, whole 
paragraphs); and 

information display means arranged to display any items of information and/or 
links thereto identified by the keyword processing means to the user (System 
Overview, lines 1-14, wherein the large projection screen is the display means, which 
provides feedback to the users). 

However, Jebara et al. does not specifically mention the information interface system 
comprising: 

speech recognition control means arranged to activate or deactivate the speech 
recognition means in response to one or more predetermined criteria. 
Conversely, Suomela et al. teach a speech recognition control means arranged to 
activate or deactivate the speech recognition means in response to one or more 
predetermined criteria (Paragraphs [0009] and [0012]). 
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It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of a speech recognition control means 
arranged to activate or deactivate the speech recognition means in response to one or 
more predetermined criteria as taught by Suomela for Jebara's system because 
Suomela provides a speech recognition system, which is automatically activated when 
needed, also with the speech recognition feature not always on, the resources of the 
device are not constantly being used (Suomela's paragraph [0012]). 

As per claims 7 and 14, Jebara et al. in view of Suomela et al., teach a system 
and method according claims 1 and 8, wherein the predetermined criteria are selected 
such that the speech recognition means is deactivated on that portion or portions of the 
voice signals which are not expected to contain keywords or phrases (Suomela's 
paragraph [0012], wherein "the device is used and the speech recognition is turned off 
when it is not needed."). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of the speech recognition means is 
deactivated on that portion or portions of the voice signals which are not expected to 
contain keywords or phrases as taught by Suomela for Jebara's system because 
Suomela provides a speech recognition system, which is automatically activated when 
needed, also with the speech recognition feature not always on, the resources of the 
device are not constantly being used (Suomela's paragraph [0012]). 
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4. Claims 2-6, and 9-13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jebara et al. ("Tracking Conversational Context for Machine Mediation of Human 
Discourse," 2000) in view of Suomela et al. (US 2002/0077830) as applied to claims 1 
and 8 above, and further in view of Rhodes et al. ("Just-in-time information retrieval 
agents," July 2000). 

As per claims 2 and 9, Jebara et al. in view of Suomela et al., teach a system 
and method according to claims 1 and 8, but they do not specifically mention wherein 
the keyword processing means further comprises: 

storage means for storing item definition data defining the items of information in 
the information database; item matching means for matching recognised keywords or 
phrases to the item definition data; and item scoring means for keeping an item score 
for each item of information in dependence upon the number of keywords or phrases 
matched to each item. 
However, Rhodes et al. teach 

storage means for storing item definition data defining the items of information in 
the information database (Page 1, 2 nd paragraph, "The information a JITIR agent 
provides can come from any number of preindexed databases of documents."); 

item matching means for matching recognised keywords or phrases to the item 
definition data (Page 8, 2 nd paragraph, "given a query, it produces a rank-ordered list of 
preindexed documents that best match the query"); 

and item scoring means for keeping an item score for each item of information in 
dependence upon the number of keywords or phrases matched to each item (Page 8, 
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2 nd paragraph, "given a query, it produces a rank-ordered list of preindexed documents 
that best match the query"). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the features of storage means, item matching means 
and item scoring means as taught by Rhodes et al. for Jebara's system, as modified by 
Suomela, because Rhodes provides an information retrieval agent (JITIR) that retrieves 
and presents information based on a person's local context (Page 1, 1 st 
paragraph/abstract), and which can also be based on automatic speech recognition 
(Page 6, 4 th paragraph, "one such technique is ASR, which is now accurate enough so 
that information retrieval on a database of raw audio news stories... ."). 

As per claims 3 and 10, Jebara et al., in view of Suomela et al. and Rhodes et 
al., teach a system and method according to claims 2 and 9, wherein the keyword 
processing means further comprises item sorting means arranged to sort the items of 
information in dependence on the respective item scores (Rhodes' Page 8, 2 nd 
paragraph, "given a query, it produces a rank-ordered list of preindexed documents that 
best match the query," also Page 4, 2 nd paragraph, "all summary lines also include a 
relevance score, consisting of zero, one, or two plus signs."). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of item sorting means arranged to sort the 
items of information in dependence on the respective item scores as taught by Rhodes 
et al. for Jebara's system, as modified by Suomela, because Rhodes provides an 
information retrieval agent (JITIR) that retrieves and presents information based on a 
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person's local context (Page 1, 1 st paragraph/abstract), and which can also be based on 
automatic speech recognition (Page 6, 4 th paragraph, "one such technique is ASR, 
which is now accurate enough so that information retrieval on a database of raw audio 
news stories...."). 

As per claims 4 and 1 1 , Jebara et al. in view of Suomela et al. and Rhodes et al., 
teach a system and method according to claims 2 and 8, wherein the keyword 
processing means further comprises item score thresholding means arranged to apply 
at least one threshold to the item scores, wherein those items whose item scores do not 
meet the threshold are not made available to the user (Rhodes' Page 4, 2 nd paragraph, 
"All summary lines also include a relevance score, consisting of zero, one, or two plus 
signs. By default, if a suggestion is below a minimum threshold, it is not displayed, and 
"no suggestion" is shown instead."). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of item score thresholding means 
arranged to apply at least one threshold to the item scores, wherein those items whose 
item scores do not meet the threshold are not made available to the user as taught by 
Rhodes et al. for Jebara's system, as modified by Suomela, because Rhodes provides 
an information retrieval agent (JITIR) that retrieves and presents information based on a 
person's local context (Page 1, 1 st paragraph/abstract), and which can also be based on 
automatic speech recognition (Page 6, 4 th paragraph, "one such technique is ASR, 
which is now accurate enough so that information retrieval on a database of raw audio 
news stories...."). 
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As per claims 5 and 12, Jebara et al. in view of Suomela et al., teach a system 
and method according to claims 1 and 8, however they do not specifically mention 
wherein the information display means is arranged to display the items of information 
and/or links thereto as a hierarchical structure, which preferably matches the hierarchy 
of the information database. Conversely, Rhodes et al. teach information display 
means arranged to display the items of information and/or links thereto as a hierarchical 
structure, which preferably matches the hierarchy of the information database (Rhodes' 
Page 3, 6 th paragraph, "The RA continually presents a list of documents that are related 
to the current document being written or read. These suggestions appear in order of 
relevance within a special display buffer at the bottom of the Emacs window."). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of information display means arranged to 
display the items of information and/or links thereto as a hierarchical structure, which 
preferably matches the hierarchy of the information database as taught by Rhodes et al. 
for Jebara's system, as modified by Suomela, because Rhodes provides an information 
retrieval agent (JITIR) that retrieves and presents information based on a person's local 
context (Page 1 , 1 st paragraph/abstract), and which can also be based on automatic 
speech recognition (Page 6, 4 th paragraph, "one such technique is ASR, which is now 
accurate enough so that information retrieval on a database of raw audio news 
stories...."). 

As per claims 6 and 13, Jebara et al. in view of Suomela et al., teach a system 
and method according claims 1 and 8, however they do not specifically mention wherein 
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the speech recognition means, the keyword processing means and the information 
display means are substantially continuously or periodically operable so as to 
continually or periodically update the items of information and/or links thereto displayed 
to the user. Conversely, Rhodes teaches speech recognition means, the keyword 
processing means and the information display means are substantially continuously or 
periodically operable so as to continually or periodically update the items of information 
and/or links thereto displayed to the user (Rhodes' Page 3, 6 th paragraph). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of speech recognition means, the keyword 
processing means and the information display means are substantially continuously or 
periodically operable so as to continually or periodically update the items of information 
and/or links thereto displayed to the user as taught by Rhodes et al. for Jebara's 
system, as modified by Suomela, because Rhodes provides an information retrieval 
agent (JITIR) that retrieves and presents information based on a person's local context 
(Page 1, 1 st paragraph/abstract), and which can also be based on automatic speech 
recognition (Page 6, 4 th paragraph, "one such technique is ASR, which is now accurate 
enough so that information retrieval on a database of raw audio news stories... ."). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Natalie Lennox whose telephone number is (571 ) 270- 
1649. The examiner can normally be reached on Monday to Friday 9:30 am - 7 pm 
(EST). 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571 )272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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